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In this paper, we generalize the algorithm described by Rump and Graillat, 
as well as our previous work on certifying breadth-one singular solutions 
of polynomial systems, to compute verified and narrow error bounds such 
that a slightly perturbed system is guaranteed to possess an isolated sin- 
gular solution within the computed bounds. Our new verification method 
is based on deflation techniques using smoothing parameters. We demon- 
strate the performance of the algorithm for systems with singular solutions 
of multiplicity up to hundreds. 

1 Introduction 

It is a challenge problem to solve polynomial systems with singular solutions. 
In [25], Rail studied some convergence properties of Newton's method for 
singular solutions, and many modifications of Newton's method to restore 
the quadratic convergence for singular solutions have been proposed in [TJ 
13 [61 El HU H21 [131 ESI EH E9l [301 EH ES|. Recently, some symbolic-numeric 
methods have also been proposed for refining approximate isolated singular 
solutions to high accuracy [21 13 SI El HOl HZl [13 [13 [231 ESI EZ] . In [2TJ [22] , 
we described an algorithm based on the regularized Newton iterations and 
the computation of differential conditions satisfied at given approximate 
singular solutions to compute isolated singular solutions accurately to the 
full machine precision when its Jacobian matrix has corank one (the breadth- 
one case). 

Since arbitrary small perturbations of coefficients may transform an iso- 
lated singular solution into a cluster of simple roots or even make it disap- 
pear, it is more difficult to certify that a polynomial system or a nonlinear 
system has a multiple root, if not the entire computation is performed with- 
out any rounding error. 

In [33], by introducing a smoothing parameter, Rump and Graillat de- 
scribed a verification method for computing guaranteed (real or complex) 
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error bounds such that a slightly perturbed system is proved to have a double 
root within the computed bounds. In [20 1, by adding a perturbed univariate 
polynomial in one selected variable with some smoothing parameters to one 
selected equation of the original system, we generalized the algorithm in [33] 
to compute guaranteed error bounds, such that a slightly perturbed system 
is proved to possess an isolated singular solution whose Jacobian matrix has 
corank one within the computed bounds. 

In [23 1, Mantzaflaris and Mourrain proposed a one-step deflation method, 
and by applying a well-chosen symbolic perturbation, they verified a multiple 
root of a nearby system with a given multiplicity structure, which depends 
on the accuracy of the given approximate singular solution. The size of the 
deflated system is equal to the multiplicity times the size of the original 
system, which might be large (e.g. DZ1 and KSS in Table [1]). 

In [39] , based on deflated square systems proposed by Yamamoto in [38] , 
Kanzawa and Oishi presented a numerical method for proving the existence 
of "imperfect singular solutions" of nonlinear equations with guaranteed ac- 
curacy. In [38], if the second-order deflation is applied, then smoothing 
parameters are added not only to the original system but also to differential 
systems independently (see (|20p ). Therefore, one can only prove the exis- 
tence of an isolated solution of a slightly perturbed system which satisfies 
the first-order differential condition approximately. 

In [8l [HI [15], Kearfott et al. presented completely different and ex- 
tremely interesting methods based on verifying a nonzero topological degree 
to certify the existence of singular zeros of nonlinear systems. 

Main contribution Suppose a polynomial system F and an approximate 
singular solution are given. Stimulated by our previous work on certifying 
breadth-one singular solutions [20] . we show firstly that the number of de- 
flations used by Yamamoto to obtain a regular system is bounded by the 
depth of the singular solution. Then we show how to move the independent 
perturbations in the first-order differential system (|20p appeared in [38] back 
to the original system. We prove that the modified deflations will terminate 
after a finite number of steps which is bounded by the depth as well, and 
return a regular and square augmented system, which can be used to prove 
the existence of an isolated singular solution of a slightly perturbed sys- 
tem exactly, see Theorem 13.71 and 13.81 Finally, we present an algorithm for 
computing verified (real or complex) error bounds, such that a slightly per- 
turbed system is guaranteed to possess an isolated singular solution within 
the computed bounds. The algorithm has been implemented in Maple and 
Matlab, and narrow error bounds of the order of the relative rounding error 
are computed efficiently for examples given in literature. 
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Structure of the paper Section[2]is devoted to recall some notations and 
well-known facts. In Section [3j we present a new deflation method by adding 
smoothing parameters properly to the original system, which will return 
a regular and square augmented system within a finite number of steps 
bounded by the depth. In Section [H we propose an algorithm for computing 
verified (real or complex) error bounds, such that a slightly perturbed system 
is guaranteed to possess an isolated singular solution within the computed 
bounds. Some numerical results are given to demonstrate the performance 
of our algorithm in Section [SJ 



2 Preliminaries 

Let F = {/i, . . . , /„} be a polynomial system in C[x] = C[xi, . . . , x n ] and 
/ G C[x] be the ideal generated by polynomials in F. 

Definition 2.1 An isolated solution of F{x) = is a point x G C n which 
satisfies: 

for a small enough e > : {y G C n : ||y - x|| < e} n F _1 (0) = {x}. 
Definition 2.2 We call x a singular solution of F(x) = if and only if 

rank(F x (x)) < n, (1) 
where i*x(x) is the Jacobian matrix of -F(x) with respect to x. 



Definition 2.3 Let Q± be the isolated primary component of the ideal I = 
(/i, . . . , f n ) whose associate prime is m% = (xi — x±, . . . , x n — x n ), then the 
multiplicity /x o/x is defined as \x = dim(C[x]/(3£), and the index p of x is 
defined as the minimal nonnegative integer p such that m£ C [35]. 

Let : C[x] — > C denote the differential functional defined by 

for a point x G C n and an array a G N n . The normalized differentials have 
a useful property: when x = 0, we have d^x' 3 ) = 1 if a = (3 or otherwise. 

Definition 2.4 The local dual space of I at x is the subspace of elements 
o/2?x = Span c {d?,a G N™} that vanish on all the elements of I 

V k := {A G Dx | A(/) = 0, V/ G /}. (3) 
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It is clear that dim('Dx) = u and the maximal degree of an element A G D x 
is equal to the index p — 1, which is also known as the depth of D x . 

A singular solution x of a square system -F(x) = satisfies equations 

det(F x (x)) = 0. W 

The above augmented system forms the basic idea for the deflation method 
[251 [261 EZ]- But the determinant is usually of high degree, so it is numerically 
unstable to evaluate the determinant of the Jacobian matrix. 

In [18] , Leykin et al. modified Q by adding new variables and equations. 
Let r = rank(F x (x)), then there exists a unique vector A = (Ai, A2 ■ ■ ■ , A r+ i) T 
such that (x, A) is an isolated solution of 

F(x) = 0, 

F x (x)5A = 0, (5) 
h T A = 1, 

where B G (Qnx(r+l) ^ g a ranc l om matrix, h G C r+1 is a random vector and 
A is a vector consisting of r + 1 extra variables Ai, A2 . . . , A r+ i. If (x, A) 
is still a singular solution of ([5]), the deflation is repeated. Furthermore, 
they proved that the number of deflations needed to derive a regular root 
of an augmented system is strictly less than the multiplicity of x. Dayton 
and Zeng showed that the depth of 2? x is a tighter bound for the number of 
deflations [I]. 

Let M be the set of real intervals, and M n and lR nxn be the set of 
real interval vectors and real interval matrices, respectively. Standard veri- 
fication methods for nonlinear systems are based on the following theorem 

[THESE]. 

Theorem 2.5 Let F(x) : M. n — » W 1 be a polynomial system, and x G M n . 
Given X G IR n with G X and M G M" xri satisfies V/<(x + X) C M;, : , for 
i = 1, . . . , n. Denote by I the nxn identity matrix and assume 

- F^(x)F(x) + (I - F x 1 (x)M)X C int(X). (6) 

Then there is a unique x G X with F(x) = 0. Moreover, every matrix M G 
M is nonsingular. In particular, the Jacobian matrix F x (ic) is nonsingular. 

Naturally the non-singularity of the Jacobian matrix -F x (x) restricts the 
application of Theorem 12.51 to regular solutions of square systems. Notice 
that Theorem 12.51 is valid mutatis mutandis over complex numbers as well. 
Next we will use this theorem to derive a verification method to prove the 
existence of an isolated singular solution of a slightly perturbed system. 
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3 A Square and Regular Augmented System 



Let a polynomial system F = {/i, . . . , f n } £ C[x] be given and x = [x\, . . . , x Tl ) 
is an isolated singular solution satisfying F(x) = 0. 

The augmented systems (j3|) and © have been used to restore the quadratic 
convergence of Newton's method. But notice that these extended sys- 
tems are always over-determined, which are not applicable by Theorem 12.51 
Hence, a natural thought of modifications is, whether we could add several 
smoothing parameters to derive a square system with a nonsingular Jacobian 
matrix. 

In [38 1, by introducing smoothing parameters, Yamamoto derived square 
deflated systems. These systems were used successfully by Kanzawa and 
Oishi in [39 J to certify the existence of "imperfect singular solutions" of 
polynomial systems. However, for isolated singular solutions with high sin- 
gularities, the smoothing parameters are added not only to the original 
system but also to differential systems independently (see ([20]) ). Therefore, 
according to (|2ip . one can only prove the existence of an isolated solution 
of a slightly perturbed system which satisfies the first-order differential con- 
dition approximately. 

In the following, we rewrite the deflation techniques in [38j in our setting, 
and prove that the number of deflations needed to obtain a regular system is 
bounded by the depth of D*, see Theorem l3.2l Then we show how to lift the 
independent perturbations in the first-order differential system appeared in 
(|20j) back to the original system. We prove that the modified deflations will 
terminate after a finite number of steps bounded by the depth of T>% as well, 
and return a regular and square augmented system, which can be used to 
verify the existence of an isolated singular solution of a slightly perturbed 
system exactly, see Theorem 13.71 and 13.81 

3.1 The first-order deflation 

Let x G C™ be an isolated singular solution of -F(x) = 0, and 



Let c = {ci, C2, . . . , (1 < ci < C2 < . . . < Cd < n) and F£ (x) be obtained 
from F x (it) by deleting its ci, C2, • • • , c^-th columns which satisfies 



rank(i ? x (x)) = n — d, (1 < d < n). 



(7) 



rank(i^(x)) 



n — d. 



(8) 



There exists a positive-integer set k = {ki, &2, • • • , kd} such that 



rank(Fx(x), Ik) = n, 



0) 



where 



(10) 
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and &ki is the fcj-th unit vector of dimension n. 

Similar to the augmented system (2.34) in [38J, we introduce d smoothing 
parameters bo = (61, i>2) • • • , bd) T and consider the following square system 

G(x,Ai,b )-| F x (x) Vl = 0, (U) 

where vi is a vector consisting of n—d extra variables Ai = (Ai, A2, • • • , X n -d) T 
and its entries at the positions c\, c^, . . . , cj, are fixed to be 1 rather than 
random nonzero numbers used in [38j. According to ([8]), the rank of F£(x) 
is n — d, the linear system i ? x (x)vi = has a unique solution, denoted by 
Ai- Therefore, (x, Ai,0) is an isolated solution of (fTT]) . If (x, Aj.,0) is still a 
singular solution, as proposed in [3B], the deflation process mentioned above 
is repeated to the first-order deflated system G and the solution (x, Ai,0). 

Note that Yamamoto did not prove explicitly the termination of the 
above-mentioned deflation process. Motivated by the results in [18} 0], we 
show below that the number of deflations needed to derive a regular and 
square augmented system is also bounded by the depth of D x . 

Let h = (O^^O, 1) T , A = (Ai, . . . , A n _ d , A n _ d+ i) T and 

n—d 

B = (ei, . . . , e„_d + i, . . . , e n _d + i, . . . , e n _d) T G £ nx ( n a! + 1 ) ) 

where ej is the i-th unit vector of dimension n — d+1. Then the augmented 
system ([5]) used in [18] is equivalent to 

a(x - Ai)= U(x)v!:o; < i2 > 

which has an isolated solution at (x, Ai), and the Jacobian matrix of G(x, Ai) 
at (x, Ai) is 

d ^ ( "' Xl) = ( F^lm °F n m ) ' (13) 

where Oij denotes the i x j zero matrix and -F xx (x) is the Hessian matrix 
of F(x). On the other hand, the Jacobian matrix of G(x, Ai,bo) computes 
to 

G ^(x,A 1 ,0)=( F f;f), i £). (14) 

Lemma 3.1 The null spaces of the Jacobian matrices dTgj) and p4\ ) satisfy 
Null (G X)Al)bo (x, A l5 0)) = j ( J ) G C 2n I y G Null (g x , Ai (x, A x )) | . 
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Proof. Ify € Null (g x , Ai (x, Ai)) then ( J j G Null (G x , Al , bo (x, Ai, 0)) . 
Suppose ( ^ j is a null vector of G XiAl ,b (x, Ai, 0). We divide y into 



Yl 

y-2 



corresponding to the blocks F x (k) and O n ^d- Therefore, we have 
F x (x) yi - J k z = 0. 



By ©, we have 

rank(Fx(x), -I k ) = n. 
It is clear that z must be a zero vector. □ 

If (x, Ai) is still an isolated singular solution of the deflated system (|12p . 
as proposed in [18], the deflation process is repeated for G(x, Ai) and (x, Ai). 
Then as shown in [3], if the s-th deflated system is singular, there exists at 
least one differential functional of the order s + 1 in D x . However, the order 
of differential functionals in P x is bounded by its depth which is equal to 
p — 1. Therefore, after at most p — 1 steps of deflations, one will obtain 
a regular deflated system, i.e., the corank of the Jacobian matrix of the 
deflated system will be zero. 

As a consequence, based on Lemma 13. 1|. we claim the finite termination 
of Yamamoto's deflation method. 

Theorem 3.2 The number of Yamamoto's deflations needed to derive a 
regular solution of a square augmented system is bounded by the depth of 

Proof. By Lemma 13. 11 we have 

corank (G XjAl (x,Ai)) = corank (G x \ lbo (x, Ai, 0)) . (15) 



Therefore, the smoothing parameters we added in the deflated system (|lip 
do not change rank-deficient information of the Jacobian matrix of the de- 
flated system ([T2|) . If corank ^G XjAl (x, Ai)^ = corank fG x ,Ai,b ( x ) Ai, 0)J > 
0, then we repeat the deflation steps to (fTTj) and (fT2|) accordingly. Induc- 
tively, we know that coranks of Jacobian matrices of two different kinds of 
deflated systems remain equal at every step. Moreover, we have shown that, 
after as most p — 1 steps, the corank of the Jacobian matrix of the deflated 
system corresponding to (|12p will become zero. Therefore, the deflated sys- 
tem corresponding to (fTTj) will also become regular after at most p — 1 steps. 
□ 
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3.2 The second-order deflation 

Suppose the Jacobian matrix Gx,Ai,b (x, Ai, 0) is singular, i.e., 

rank(G X)Alibo (x,Ai,0)) = 2n - d! , (d! > 1). (16) 

Let c' = {c' l5 c' 2 , . . . , c' d ,} and k' = {A^, k' 2l ■ ■ ■ , A;^/} be two positive-integer 
sets such that 

rank(< Alibo (x, Ai,0)) = 2n - d! , (17) 



rank (G£ iAljbo (*, A i; 0), 7 k , +n J = 2n, (18) 

where £? xAl b (x, Ai,0) is a matrix obtained from G x ,\i,bo( x ) Al,0) by delet- 
ing its Cj_, c' 2 , . . . , c^,-th columns, and 



(19) 



Theorem 3.3 Comparing to _F x (x) ; i/ie corank o/ Cr XiAljbo (x, Ai, 0) does 
no£ increase, i.e., d' < d. Moreover, we can choose c' and k' such that 
c' C c, k' C k and satisfy p7\ ) and [T8\) respectively. 

Proof. Let 

be the matrix obtained from G XjAljbo (x, Ai, 0) by deleting its c%, C2, . . . , c^-th 
columns. By ([8]) and © we claim that 

rank(G£ iAl)bo (x,Ai,0)) = 2n - d. 

Hence d' < d. Besides there exists a positive-integer set c' C c such that 
the condition (fTTj) is satisfied. 

According to ([9]), it is clear that 

rank(G x Al bo (x, Ai,0),/ k+n ) = 2ra, 

where Ik+n = ( ^ . Hence we can choose k'Ck such that the condi- 

tion ([TBI) is satisfied. □ 



If g?' > 1, then Yamamoto repeated the first-order deflation to G(x, Ai , bo) 
defined by (jlip . By Theorem 13 .3|. we notice that Yamamoto's second-order 
deflation is equivalent to adding d' new smoothing parameters denoted by 
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t>i to the first-order differential system F x (x)vi = 0, to derive a square 
system 



#(x,A,b) 



F(x) - I k b = 0, 
F x (x)vi - I k ,bi = 0, (20) 

k G ! X) A 1 ,b ( X )^l) b o)v2 = 0, 



where V2 is a vector consisting of 2n — d' extra variables A2 and its entries at 
the positions c' l5 c' 2 , ■ ■ ■ ,c' d , are all 1, and b = (b^ , b^) T , A = (A^f, A^) T . Let 
A2 denote the unique solution of the linear system G Xj .\i,bo(x> Ai, 0)v2 = 0, 
then (x, A, 0) is an isolated solution of ([20)) . 

Suppose Theorem 12.51 is applicable to the deflated system i7(x, A,b), 
and yields inclusions for x, A, bo and bi. Then we have 

F(x) = F(x) - / k b = and F x (x) Vl = F x (x)vi = I v b 1: (21) 

where smoothing parameters bi might be very small, but are not guaranteed 
to be zeros. Therefore, one can only prove the existence of an isolated solu- 
tion x of a perturbed system F(x), which satisfies the first-order differential 
condition approximately. 

In order to verify the existence of an isolated singular solution of a slightly 
perturbed system, we should add the smoothing parameters bi back to the 
original system. Let us consider the modified system: 

r F(x) - I k b - Xibi = 0, 
ff(x, A, b) = <^ _ F x (x)vi - 7 k ,bi = 0, (22) 
I Gx.Ai.boCx, Ai,bo,bi)v 2 = 0, 

where X\ = (x c / ey , . . . , xj ey ) and 

r(* \ h h\ - S F ^ ~ /kb ° ~ Xlhl = °' oi\ 
G(x, A l5 b , bi) - I Fx(x)vi _ 4 = Q (23) 

Theorem 3.4 Let 

F(x, b) = F(x) - I k b - Xibi, (24) 

t/ien we have 

F x (x) Vl - 7 k /b! = <=► F x (x, b)vi = 0. (25) 

Proof. Let 

bi = (61,1,61,2, • • • , 6i,d') T and vi = (Ai, • • • , 1 , • • • , 1 , • • • , \ n -d) J ', 
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then 



.F x (x, b)vi = F x (x)vi - (0, • • • , 6i,ie fc / , • • • , h^eu , • • • , 0) v x 



d>' 

.1 

d> 



^x(x)vi - (e fc / , . . . , e fc / ; ) bi (since c' C c) 
-Fx(x)vi - 4'bi 



□ 



According to Theorem 13.4^ we can rewrite the system (|22p as 
ff(x,A,b) = < 



_ F(x,b) =0, 

F x (x,b)v 1= 0, (26) 
G f x,A 1 ,bo( x >^ijbo,bi)v 2 = 0. 



Therefore, if we can certify that (x, A, b) is a regular solution of the aug- 
mented system H(x, A, b) based on Theorem 12, 51 then by (|26p . x is guaran- 
teed to be an isolated singular solution of F(x, b). 



Theorem 3.5 Jacobian matrices of I120\) and 1122]) share the same null space. 
Proof. The Jacobian matrix H x \,b ( x > A, 0) of (f2"0j) computes to 

/ -Px(x) On,n-(i n On,d' \ 

Fxx(*)Vl F x C (x) O n4 V2n,2n-d' 

O n>d F?(k) O n , n _ d -J k O n4 

V * * ^x C ( x ) O n4 O n4 J 

( 27 ) 

while the Jacobian matrix H x> x,b(^ A, 0) of ([22]) computes to 

/ F x (x) O n , n _ d -J k -X \ 

F XX (X)V! F X C (X) n , d ^ ^2n,2n- d ' _ ^ 

°n,d ^x'( X ) Cn,n-d ~4 

V * On,d * F x c (x) n ,d n , d , / 

(28) 

where the matrix X consists of vectors £ c '(i) e k'(i)> i = 1, ■ ■ ■ ,d' . Since k' C k, 
we can reduce the last column of the block matrix ()28p by its third and sixth 
columns to get the block matrix (|27p . Therefore, two Jacobian matrices (|27|) 
and ()28p are of the same corank and share the same null space. □ 

Suppose the Jacobian matrix H x ,x,b( x > A, 0) is still singular, i.e., 

rank(# xAb (x, A, 0)) = 4n - d", (d" > 1). (29) 
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Let c" = {c'{, c'2, . . . , c^,/} and k" = {k'{ , fc^' , • • • , k'^,} be two positive-integer 
sets such that 

rank(i^" Ab (x, A, 0)) = 4n - d" (30) 

rank (iT£' Ab (x, A, 0), Ik» +3n ) = 4n, (31) 

where H^' Xh (ic, X,0) is a matrix obtained from .ff xAb (x, A, 0) by deleting 
its c'/, c 2 ' , . . . , c' d '„-th columns, and 



^k"+3n = f ^ , = (efc» , e fc » , . . . , ] 



(32) 



Theorem 3.6 Comparing to G XjAlibo (x, Ai, 0), the corank of -ff x ,A,b( x , A,0) 
does no£ increase, i.e., d" < d' . Moreover, we can choose c" and k" such 
that c" C c', k" C k' and satisfy llcl(J\) and respectively. 

Proof. Similar to the proof of Theorem 13.31 let fZ^' A b (x, A, 0) be the 

matrix obtained from -ff Xi A,b(x, A, 0) by deleting its c[, c' 2 , . . . , c^-th columns. 
By (TT7J) and (fTgl). we claim that 



rank(i^' A b (x, A, 0)) = 4n - d'. 

Therefore, d" < d', and there exists a positive-integer set c" C c' such that 
the condition ([30]) is satisfied. 

Meanwhile, we know that rank(G£ Al bo (^' !> -^k'+n) = 2n 3 then 

rank(#£' A b (x, A, 0), J k '+3n) = 4n, 
where Ik'+3n = ( ^^ n ' d J . Therefore, we can choose k" C k' such that the 



4' 

condition (f3"Tj) is satisfied. □ 

EXAMPLE 3.1 Q Z?Zi_/ Consider a polynomial system 

F = {x\ — X2X3X4, x\ — X1X3X4, x\ — X1X2X4, x\ — £1X2X3}. 

The system F has (0,0,0,0) as a 131-fold isolated zero. 

Since F x {k) = O44, we derive d = 4, c = k = {1,2,3,4} and vi = 
(1,1,L If 

F(x) - / k b = 0, 

4xf — X3X4 — X2X4 — X2X3 = 0, 
G(x, bo) = < 4x| — X3X4 — X1X4 — X1X3 = 0, 
4xg — X2X4 — X1X4 — X1X2 = 0, 
4x^ - x 2 x 3 - X1X3 - xix 2 = 0. 
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Gx,b (0,0) 



The Jacobian matrix of G(x, bo) at (0,0) is 

04,4 — 
04,4 04,4 

Hence, dl = 4, c' = k' = {1, 2, 3, 4} and 

r F(x) - I k b - Xxbx = 0, 
H(x, A, b) = < 3(x)vi - J k ,bi = 0, (33) 
I Gx,b (x,bo,bi)v 2 = 0, 

where v 2 = (1, 1, 1, 1, Ai, A 2 , A3, A4) 71 , and G x ,b (0, 0, 0)v 2 = has a unique 
solution (Ai, A 2 , A3, A4) = (0,0,0,0). The Jacobian matrix of H(x, A,b) at 
(0,0,0) is 

/ 04,4 ~^k 04,4 04,4 \ / -2 -2 -2 \ 

04,4 04,4 04,4 —ly 
04,4 04,4 — I\t' —I\t' 
\ A 04,4 04,4 04,4 j \ 

The Jacobian matrix -£f x ,A,b(0, 0, 0) is nonsingular. Therefore we obtain a 
regular and square system H (x, A, b) and a perturbed system 



#x,A,b(0,0,0) 



,A 











-2 
-2 
/ 



F(x,b) 



,7, 2 
1 



61 - 65x1 = 0, 

6 2 - b 6 x 2 = 0, 

63 - 67x3 = 0, 

64 — bgXi = 0. 



- X2X3X4 

X1X3X4 
X1X2X4 

l, 4 - XiX 2 X 3 

Applying the verification method based on Theorem 12.51 to H(x, A,b), 
we show in Section 0] that a slightly perturbed polynomial system F(x, b) 
for 

\k\ < l-0e - 321, i = 1,2, . . . ,8 
has an isolated singular solution x within 

\ Xi \ < l.Oe - 321, i = 1,2,3,4. 



3.3 Higher-order deflations 

For higher-order deflations, in the following, we show inductively how to 
add new smoothing parameters properly to the original system in order to 
derive a square and regular deflated system for certifying the existence of 
an isolated singular solution of a slightly perturbed system. 

Let H(°)(x) = F(x), then for the (s + l)-th deflation, we add smoothing 
parameters b( s ) = (b^, . . . ,bJ) T and consider the following square system 

F(x,bW) =0, 
F x (x,b( s ))vi =0, 

(34) 



H (s+i) ( x A («+i) b («h 



G 



x^W.bC'- 1 ) 



yCx.AW.bWjv.+i =0, 
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where A^ s+1 ^ = (Xj , . . . , Aj +1 ) T are extra variables corresponding to the 
vectors {vi, . . . , v s+ i}, G^ s ^(x, X^ s \ h^) consists of the first 2 s n polynomials 
in tf( s+1 )(x,A (s+1) ,b( s )), and 

F(x, b( g )) = F(x) - X h - X x h x X s b s , (35) 

the matrix Xj (0 < j < s) consists of vectors jj • ' e kO)(«)' * = 

1,. . . ,dj, where and k^are two positive-integer sets selected at the j- 
th order deflation satisfying conditions obtained by replacing the polynomial 
system F(x) in © and Q by the j-th deflated system H^\x, A (j) , b^' -1 )) 

and replacing I k by the matrix / k W)+(:y-l)n = f °( 23 -^ n ' d J J , J k(j) = 
(e fe ( 3 ),e fc(j) , . . . ,e fc( j)), where d, is the corank of b(j ._ 1) (x, A 0) , 0). 

1 2 dj > i 

Theorem 3.7 T/ie corank d s +i o/ ■H'^ws+i) b ( S ) A^ + ,0) does noi in- 
crease and the number of deflations needed to derive a regular solution of an 
augmented system {3$ is less than the depth ofD-^, i.e., we have 

d > di > ■ ■ ■ > d s+1 > ■ ■ ■> d p _i = 0. (36) 

Moreover, we can choose c^' and ley) satisfying 

c («) c • • • C c(°) and kW C • • • C k<°>. (37) 

Proof. Applying Theorem 13.31 13.51 and 13.61 inductively, we can show that 
the above deflation process (|34p produces a decreasing nonnegative-integer 
sequence do > di > • • • > d s+ i > • • • , which is as same as the sequence 
consisting of coranks of the Jacobian matrices of the deflated systems by 
Yamamoto's method. According to Theorem l3.2l the number of Yamamoto's 
deflations to derive a regular solution of an augmented system is bounded 
by the depth of T>±. Hence the number of the modified deflations (|34|) is 
also bounded by the depth of V^. The proof of ([37]) is similar to the proofs 
of Theorem 13.31 and 13.61 □ 

Theorem 3.8 Suppose Theorem \2.5\ is applicable to the augmented system 
(3~4\ ), and yields inclusions for x, A and b. Then the perturbed system 
F(x, b) has an isolated singular solution at x. 

Proof. Since (x, A, b) is the unique solution of the augmented system 
(f34"j) . we have 

F(x,b) = and F x (x,b)vi = 0, vi ^ 0. 
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Hence, x is an isolated singular solution of the slightly perturbed system 
F(x,b) = F(x) - X b - Xibi - • 



X s b s . 



□ 



EXAMPLE 3.2 Q DZ2] Consider a polynomial system 
F = {x 4 , x 2 y + y 4 ,z + z 2 - 7x 3 - 8x 2 }. 
The system F has (0,0, —1) as a 16-fold isolated zero. 
The Jacobian matrix of F at x = (0, 0, —1) is 


F x (x) = ( ) , so that d = 2 and we choose c (0) = k (0) = {1, 2}. 
0-1 



The first-order deflated system is 
fl-W(x,Ai > bo) = < 

where 



F(x) - X b = 0, 
4x 3 = 0, 
2xy + x 2 + 4y 3 = 0, 
-21x 2 - 16x + Ai + 2zAi = 0, 



1 

= (ei,e 2 ) = | 1 




b n 



b 2 



, v 1 = (l,l,A 1 ) T , Ai = (Ai). 
The Jacobian matrix of J?W(x, Ai,bo) at (0,0,-1,0,0,0) is 



/ 














-1 





\ 



















-1 












-1 

























































V 


-16 








-1 








/ 



d\ = 2 and we choose c (1) = k (1) = {1,2}. 



Therefore, we derive the second-order deflated system 
tf( 2 )(x,A( 2 ),b«) 



F(x) - X b - Xibi = 0, 
F x (x) Vl - X[bi = 0, 



<A 1 ,b ( X ' A l' b(1) ) V 2 = 0, 
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where 



X 




bi 



) , b« = (h,b 2 ,b 3 ,b 4 ) T , X[ = ( 1 j , 



v 2 



(1, 1, A2, A3, A4, As) T , A^ — (Ai, A2, A3, A4, A5) 71 . 



Moreover, G^ Xi b (x, A v / ,0)v2 = has a unique solution A2 = (0, — 16,0, 0) 1 . 
For the third-order deflation, we have d,2 = 1, c^ 2 ) = k^ 2 ) = {1}, so 
( 



c(i) 



^( 3 )(x,A( 3 ),b( 2 )) 



F(x) - X b - Xibi - X 2 b 2 = 0, 
F x (x)vi - X(bi - X 2 b 2 = 0, 
F x (x)v' 2 - X v 2 ' - X{bi - X 2 b 2 = 0, 



i ? xx(x)v 1 v' 2 + F x c(0) (x)A 3 - X 2 'b 2 = 0, 

; x ,A( 2 ),b( 2 ))v 3 = o, 



(38) 



G 



(2) 

x,A (2) ,b(l) 



where 



Xo 



1 T 2 
2 






(65), x 2 



x y 









|, x-| 


: 


J 








1 v 2 



Aj 

A 5 



Moreover, G 



(1,A 6 ,A 7 ,...,A 16 ) T , A^ = (Ai, 

;( 2 ) 



Aie) 



r 



v 3 

x A (2) bM ^ ' ^) V3 = ^ ^ as a urnc l ue solution 
A 3 = (-2, 0, 0, 0, -16, 0, 0, -16, 0, 0, -42) T . 



Finally, the Jacobian matrix of i/( 3 )(x, X^ 3 \ h^) is nonsingular, and we 
obtain a perturbed polynomial system 

F(x, b) = F(x) - X b - Xibi - X 2 b 2 
1 



= K - b l 
Note that 



6 3 x - -b 5 x , x 2 y + y -b 2 -b 4: y,z + z - 7ar - 8x }. (39) 



F x (x)vi - X^ - X(b 2 = ^ F x (x, b)vi = 0, 



after applying the verification method to the above regular augmented sys- 
tem ([58]) . we are able to verify that a slightly perturbed system F(x, b) 
defined in (1391) for 



1,2,... ,5 



\bi\ < l.Oe - 14, i = 
has an isolated singular solution x within 

\xi\ < l.Oe - 14, i = 1,2, and |1 + x 3 \ < l.Oe 



14. 
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4 An Algorithm for Verifying Multiple Roots 

Based on Theorem l3.7l and l3.8l we propose below an algorithm for computing 
verified error bounds such that, a slightly perturbed system is guaranteed 
to possess an isolated singular solution within the computed bounds. 

Algorithm 4.1 VISS 

Input: A square polynomial system F E C[x±, . . . , x n ], a point x £ C n and 
a tolerance e. 

Output: A perturbed system F(x, h), inclusions X and B for x and b such 
that .F(x, b) = and F K (pc, b) is singular. 

1. Set s := 0, m := n, F := F, G := F , y : = x, and y := x. 

2. Compute d := n — rank(i ? x (x), e), select integer sets c and k satisfying 
|2j) and (OJ) respectively. 

3. Set F := F + X s h s , where the matrix X s consists of vectors • • 
ek(i); i = l,-..,d. 

(a) If s > 1, i/ien sei G := F; for j from 1 to s do 
G := {G,G y Vj}; y := (y, Xj, bj-x). 

(b) Compute y := (y, LeastSquares(G y (y)v s+ i = 0),0); 

(c) Set G := {G, G y v s+ i}; y := (y, X s+ i, b s ); m := 2m. 

4- Compute d := m — rank(G y (y), e); 

(a) If d = 0, apply verifynlss to G and y to compute inclusions X 
and B for x and b. 

('oj Otherwise, select c, k satisfying /of polynomial system 

G, set s := s + 1, y = x and 50 fracfc to S"top 5. 

Example 3.1 (continued) Given an approximate singular solution x = 
(.0003445, .0009502, .0003171,. 0006948) and a tolerance e = 0.005, we ob- 
tain the augmented system (f33j) and a point 

y = (x, 0.8009 x 10" 6 , 0.4236 x 10~ 7 , 0.8859 x 10" 7 , 0.5374 x 10~ 7 , 0, . . . , 0). 
After running verif ynlss(-ff, y) in Matlab |32j . it yields 

-l.Oe - 321 < Sn < l.Oe - 321, for i = 1, 2, 3, 4, 

-l.Oe - 321 < Sj < l.Oe - 321, for i = 1, 2, . . . , 8. 

By Theorem 13.81 this proves that the perturbed polynomial system F(x, h) 
(\bi\ < l.Oe — 321, i = 1, 2, . . . , 8) has an isolated singular solution x within 
\ Xi \ < l.Oe- 321, i = 1,2,3,4. 
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Special case The breadth-one case where the corank of the Jacobian ma- 
trix equals one occurs frequently, and can be treated more efficiently. 

In fact, we have shown in \22\ Theorem 3.8] that each step of deflation 
described by (|5|) only reduces the multiplicity \i of the singular solution x 
by 1. According to Theorem 13. 7\ the number of deflations described by 
(|34p will be \x — 1. Hence, Algorithm VISS generates an augmented regular 
system of the size (2^ 1 n) x (2^- l n). However, in [2D], we introduced a more 
efficient method based on the parameterized multiplicity structure, to obtain 
a deflated regular system G(x, b, A) which is of the size (/m) x (fin) and can 
be used to verify not only the existence of an isolated singular solution, but 
also its multiplicity structure. 

Let us introduce briefly the method in [20J for the special case of breadth 
one. By adding \i — 1 smoothing parameter bo, bi, . . . , 6 M -2 to a well selected 
polynomial, assumed to be fx, we derive a square augmented system 



G(x,b,A) 



Li(F) 



0, where F(x, b) 



/ /i(x) 



V 



Efj,— 2 b v x\ 

/ 2 (x) 



/n(x) 



/ 



and Li, . . . , L„_i are parameterized bases of the local dual space in variables 
A. Furthermore, we proved that if Theorem 12.51 is applicable to G and 
yields inclusions for x G M n , b G M.^ 1 and A G rO^M™- 1 ) SU( ^ t h a t 
G(x, b, A) = 0, then x is a breadth-one singular solution of F(x, b) = 
with multiplicity (j, and {1, L±, . . . , L^—i} with A = A is a basis of T>±. 

EXAMPLE 4.1 133[ Example J^.ll] Consider a polynomial system 

t = \X1X2 — XiX 2 , X\ — x 2 \- 

The system F has (0, 0) as a 4-fold isolated zero. 

We choose X2 as the perturbed variable and add the univariate polynomial 
— b\ — 62^2 — ^2 X \ t° the first equation in F to obtain an augmented system 



x\x 2 



x\x\ 



b 2 x 2 - ^x\ 



2\\X\x 2 — \\x\ + x\ — 2x\x 2 



0, 

x\ — x 2 = 0, 
62 - b 3 x 2 = 0, 
Ai - 2x 2 = 0, 

X1X2 + 2X\X\ — 2X1X2 + 2A2X1X2 — A2X2 — x\ — = 0, 

A 2 - 1 = 0, 

Af + 2AiA 2 x 2 - Ai + 2A 2 xi - 2A 2 x 2 + 2A 3 xix 2 - A 3 x| = 0, 

A 3 = 0, 

which is of the size 8x8 while Algorithm VISS generates a system of the 
size 16 x 16. Applying verif ynlss with an initial approximation 



(0.002, 0.003, -0.001, 0.0015, -0.002, 0.002, 1.001, -0.01), 
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we obtain inclusions 



-l.Oe - 14 < Xi < l.Oe - 14, for i = 1, 2, 3, 

-l.Oe - 14 < hi < l.Oe - 14, for % = 1, 2, 3. 

This proves that the perturbed system F(x, b) < 10 14 , i = 1,2,3) has 
a 4-fold breadth-one root x within < 10~ 14 ,i = 1,2,3. 

5 Experiments 

We can generate an augmented square and regular system and initial values 
for y in Maple or Matlab, then apply INTLAB function verifynlss in Matlab 
|32j to obtain the verified error bounds. The following experiments are 
done in Maple 15 for Digits := 14 and Matlab R2011a with INTLAELV6 
under Windows 7. Let n be the number of polynomials and variables, \x 
be the multiplicity. The fourth and fifth column show the decrease of the 
corank and the increase of the smallest singular values of the Jacobian matrix 
respectively. The last two columns give qualities of the verified error bounds. 

The first three examples DZ1, DZ2, DZ3 are cited from [4J. It should be 
noticed that the coefficients of polynomials in the example DZ3 have alge- 
braic numbers y/E, y/7. These irrational coefficients are rounded to fourteen 
digits in Maple or Matlab. The other examples are quoted from the PHC- 
pack demos by Jan Verschelde. Codes of Algorithm VISS and examples are 
available at http : //www .mmrc . iss . ac . cn/~lzhi/Research/hybrid/VISS. 
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